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ABSTBACT 

The SWBL Kindergarten Program was developed by the 
southwest Begional Laboratory for Educational Besearch and 
Development (SWBL), a federally funded facility located in Inglewood, 
California. In Birmingham, interest in the SWBL program was . 
stimulated and developed during the Fall of 1971. It was felt that 
this program would provide the children with an opportunity to be 
exposed to an early reading program., The components of the SWBL ; 
Program consisted of the instructiotia:^ Concepts Program (ICP) which 
was intended to introduce the children to concepts of shape, size, 
color, amounts, poisitions, and cpmpai^isons. Upon completion of the 
ICP, the Beginning Beading Program (BBT) was initiated. The goals of 
this program were to teach the children word recognition and the 
vocabulary of the program design. |SOme support systems were also 
developed to aid the children in maintaining or improving their 
acquired' skills. (Author/DEP) \ '■ ' \ 
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TIE SWRL KINDERGARTEN PROGRAM 



INTRODUCTION 



The SWRL Kindergarten Program was developed by the Southwest Regional Laboratory 
for Educ^ational Research and Development (SWRL) a federally funded facility 
located in Inglewood, California. ' The materials and procedures were developed 
through carefully sequenced studies and extensive field tryouts involving more 
than 100,000 children over a period of four years. 

'Each of the Kindergarten Program components underwent continuous sequential 
evaluation which resulted in modification of the program oh the basis of pupil 
performance data and teacher reactions.. When the program had been refined 
to the point where it was ready for widespread dissemination, federal funds 
were made available under Title III of f.he Elementary and Secondary Education 
Act. 

' ' ' • \ 

In D-Jrmingham, interest in the SWRL Kindergarten Program was stimulated and 
developed during the -fall of 1971. It was felt this program held promise to 
meet a need of many of our children, viz to provide an opportunity for them 
to be exposed ^to an early reading program. Initial orientation of Elementary 
Principals regarding the features of the program was arranged through the 
office of the Director of iZlementary Education. In turn, interest was gener- 
ated among the Kindergarten Teachers- in the district. With the assurance that 
sufficient support was apparent among teachers and principals^ and with the 
approval of the Board of Education, a federal grant was requested and approved 
through the Michigan Department of Education. 

The principal and a kindergarten teacher in eight of our schools agreed to 
participate in the program. It was subsequently implemented^at Bingham ^arms. 



participate m une program, xu wda auuocviwcuu ^.j — — o 

^IBomfielia-Tillage, Evergreen, Franklin, Pembroke,-Quarton, Torry and Walnut 

Lake in September, 1972. We would like to express appreciation to Dr. Velma 
- Ruhly, Principal of Franklin Elementary School, for her help, in coordinating 
this program. 

COMPONENTS OF THE SWRL PROGRAH 

The Ins tructional Concepts Program ^ 

(1) 

This component consists of 96 concepts pertaining to colors, sizes, 
shapes, amounts, positions and compariso^rS^i This component is intro- 
duced during the first month of school and runs for about 12 weeks. 
Successful participation in this sequence enables each child to utilize 



(1) See Appendix A 
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the .96 concept terms. These concepts are considered basic to later success 
in academic programs. Many' Birmingham children enter school with prior 
understanding of many of these concepts. -This part of the program, there- 
fore, may be offered on a partial or complete basis or omitted depending 
on the needs of the children in each individual school. 

The Beginning Reading Program 

Known originally as the First Year Communication .Skills Program, this 
component' has been renamed the Beginning Reading Program (BRP). The 
goals of the program are , well defined (2), At the end of the 30 week 
sequence children should be able to: 

1. Read the 100 words taught directly in the program. 
y2. Sound out and read new words composed of word elements 

taught in the *program. 
3. Demonstrate comprehension of the material read. 

Instructional materials include individual story books that the children 
may keep and take home, flash cards, games, comprehension sheets, criterion 
exercises, and practice exercises. The progranTis organized into 10 units 
each' requiring about 3 w^eks to complete, assuming an instructional period 
of about 25 minutes per day. 



SUPPORT SYSTEMS 

The Tutorial Program 

Upper grade pupils, aides or other non-professionals are trained to use 
specially prepared materials and procedures to tutor kindergarten pupils. 
The Tutorial Program, supplements regular classroom instruction by provid- 
ing additional practice for those chiTdren who have not yet attained " 

The Parerit-Assisted teaming Program (PAL) 

pXl supplements regular classroom instruction of BRP students throtigh the 
cooperation and structured assistance ^of each child* s parents. Parents 
are trained- to use instructional exercises and learning games that 
provide practice in specific reading skills being developed by the 
teacher. in the classroom. 



(2) Appendix B 
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The Summer Reading Pro^rain ^ . 

A ten week parent-guided summer program following the kindergarten year 
ji is optional and is designed to help the children maintain and improve the 
reading skills acquired in kindergarten. 



TEACHER INSERVICE : . , 

Teachers in^ the program received two half-days of inservlce prior to implementa- 
tion of the program and two shorter sessions during the course of the kinder-^ 
garten year. This training was provided by the Program Coordinator, Dr. Velma 
Ruhly who had been given prior inservice. 

PARENT dklENTATION " ^ . - 

In order to gain the support of parents and to enlist their cooperation in 
participating with their children in the program, an orientation meeting was _ 
conducted in most schools.. Parents were invited in and given an explanation of 
what the program was , designed to do. Printed materials, designed to provide 
information about the program, were distrijjuted and 'discussed. 



.PROGRAM PROCEDURES- AND EVALUATION ACTIVITIES ' • 

Each child enrolled in the program was given an entry survey test. This test 
- was intended to determine the entry level of the children, with regard to the . 
goals of the program. With "28 being the highest possible score, school means 
range from 13.5 to. 15.8 with'? district mean of. 15.1 (see Table I). . 

The Instructional Concepts Program was introduced in September or October and 
completed in December or January. An end-of-program ICP Test was given and 

~-^the-results-sent-to-the-Region»l-I^b,.— Table--I_shows_±hat_OAit_jif_a_i^^^ 

. score of ,30 the means ranged from 27.1 to 29,4 with a district mean of 28V0. • 

About three weeks after the ICP began, children were introduced to the Begin- 
ning Reading Program. These two programs ran simultaneously for a few weeks 
until the ICP was completed'. The BRF then continued to the end of, the ■ school 
year. At that time an end-of.-program test was given to all students who had 
completed all or most of the program. These results were also sent to the 
■ Regional Lab for analysis(3). Table I show.s results of the four subtests. 

' * . ' 

' The highest possible score on the sight word subtest was iS. The school means 
ranged from 13. 3, to 17.8 with. a district mean of 14.7. . , 
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TABLE I 

SUMMARY OF EVALUATIVE MEASURES 
SWRL KINDERGARTEN PROGRAM 



SCHOOL - 


Entry Survey 
(0—28) 
Mean 


^ICP 
(0—30) 
Mean 


Sight Words. 
(0-18) 
Mean 


Word Element 
(0-9) 

Mean- 


Letter Names 
(0-61 
Mean 


Sentences 
(0-101 
. Mean 


SWRL A 


13.5 


27.1 


15.0 


7.7 


5.7. ; 


.6.0 


SWRL B. 


13.9 


28.0 


16.0 


8.4 


5.f - 


8.8 


SWRL C 


15.1 


27.8 


13.8 . " 


N. 7.3 


5.7 


6^.4 - 


SWRL D 


15.3 


27.4 • " 


15.8 . 


' 8^ ; Q 


5.7 


8.1 


SWRL E' 


15.4 


29.4 


16.9 


8.8 


5.7 


9.0 


SWRL F 


15.5 ■ 


28.3 


17.4 


8.7 . 


"5,6 

\ 


9.1 


SWRL G 


15.7 


27.9 


13.3 


■ 6.2 


C Q - 
. 5 . O 


^ ft 


SWRL H 


15.8 


27.4 


17.8 


8.9 


5.9 


9.9 


SWRL 

All Schools 


15.1 


28.0 


14.7 


8.0 


5.7 


7.8 


Control I . 






. 9.1 


5.4 


5.2 


■ .4 


Control J 






' 10.4 


6.2 


5.7 


.9 


Control K 






11.1 


5.1 


5.0 


1.3 


Control 
All Schools 






10.2 


5.6 


5.3 • . 


,9 
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Fot wotd elements the highest possible score-ws-^re^— ^Ihgmeans ranged from 
6.2 to 8.9 wij;h a district, mean of 8.0. The highest possib"te-s^ for Letter 
Names was 6.0'. School -means ranged from 5.6 to 5.9, district meai!-^^^ 
Sentence understanding had a possible high score of 10.0. Means ranged" 
3.8 (an isolated low) -to 9.9 with a district mean- of 7.8 

The Beginning Reading Program being the component considered most challenging 
and with the greatest potential for Birmingham children, the decision was made 
to compare achievement of SWRL children with children who had not been xn the 
program. A random sample </f three non-SWRL schools was selected. The BRE 
cnd-of--program test was administered to those three control classes. Table I 
summarizes these results. There were no significant differences between thxs 
control group and the SWRL children on, the letter naming subtest. However, on -tne 
other three subtests, viz., sight wor^s, word elements and sentence understand- 
ing, the ^^RL children performed significantly better. The difference xn 
sentence understanding was especially dramatic. s.^ 

No comparison was attempted with the -ICP .due to the belief that kindergarten 
■ teachers do an effective job of teaching these concepts using other methods. 

In addition to test 'results of children at the end of the first year, it was 
determined we should have opinions of teachers, principals, and parents ot 
-children who participated in the program. Therefore, these groups. were 
surveyed . . . / ■ ^ / 



Parent Survey Results ^"^^ 



/ 



In late May of 1973, an opinionnaire was sent to each of the 217 parents 
who had children in the program. One hundred forty nxne (149) were 
returned (68.7%). District results may be found in Appendix D. A summary 
of some of the more important questions should be of interest and helpful 
in assessing the value of the program. 



Ninety-three percent of the parents indicated their children enjoyed 
participation in the program much or very much; 1.4% indicated thexr 
children enjoyed participation very little or not at all. Ninety percent 
said they believed the objectives of the ICP had been accomplxshed very, 
wer . Combining rtoderat6ly well with very well fche^percent was 100/., 
For the' Beginning Reading program the results were 78.3% and 98.6/o \ , 
respectively whereas 1.4% thought objectives of the program were not bexng 
accomplished with their children. ' }. 

? ■ * ^ 

Compared vnh other kindergarten programs pa^rents were familiar with, 85.6% ■ 
rated the SWRL Program as superior. Parents' indicated, the program stimulated 
-and challenged their child (81.9%) whereas 2.7% said they felt the.prograro 
had unduly pressured their child. % 
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' Of the parents who participated in the PAL Program, 81.3% said it was 
effective. Seventy five percent said they felt their child was very 
well prepared, for the second year of school and 22.97o indicated adequate 
pr.eparation; only 2.17o felt their child was poorly prepared. Parents 
said their children were reading other materials at home (79.6%). Almost 

' 97% indicated the progranushQuld be continued or expanded, while 3% 
thought *it should be eliminated. . _ - 

These ^Joults suggest quite clearly that parents whose children participated 
in the program were very favorably Impressed and desired that it should- 
be continued. 

Teacher Survey Results 

i . ' ' 

In March the teachers were surveyed to determine if they would want to 
continue the program for another year. Eight teachers, started the pro- , 
gr^ in September and a ninth was added in the spring. Some questions, 
therefore, had, 8 respondents and some 9« Participation in the ICP was / 
satisfying to all the teachers. Seven expressed satisfaction with the/BRP, 
one was dissatisfied and one found it "so-so". All teachers indicated 
children enjoyed participation in both ICP and BRP. 



With regard uo the time required to teach the ICP, four thought it was just 
right and four felt it was excessive. Six teachers felt the instructional 
time was just right for the BRP, two indicated it was excessive. In tenuis 
of being ready for the next school year, four .teachers thought their 
children were better prepared and four thought the preparation was about 
the same. . . . 

Objectives of the ICP were assessed to have b&en "accomplished very wdll 
by Mven of the eight teachers and moderately well by one. For the BRP, 

' six indicated objectives had been accomplished very well and ^three moder- . 

ately^elU Seven .t eachers^who~used-J:he^PAL Jxogram^sai<LJiLJ»as.^^ ./J. 

The four teachers who used the Tutor Program foun^ it to be helpful. '/ 

Recordkeeping was conside^red time-consuming but necessary by 7 of the 

teachers; one found it unnecessarily time-consuming. Seven of the teachers 
• indicated the SWRL Program did not conflict with their philosophy of ,^ 

kindergarten instruction, two teachers indicated there was some conflict. 
. Seven teachers felt the inservice they received was adequate to very 

adequate; one felt it was inadequate. Eight ^'aachers expressed a desire 
■ to continue to participate in. the SWRL Program. One chose not to 

continue. Six teachers said the program should be continued and expanded; 

no one suggested it be eliminated. 



(5) Appendix E 
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The large majority of teachers who participated ' in the program were sat is- 
itie large majonuy <jl ,\ r>«-rtoram Thev wished to continue in it 

' able to other schools on an optional oasis. \.o<sc 
' Minutes April 10, 1973). 

^ Administrator Survey Results ^^^ v ^"N^ . 

•Principals of the eight Schools were surveyed in March at the same time as 
• _teachers. Six principals agreed With teachers uhat the program stimulated 
and challenged the children, one ^aw no^notic^eable difference and one saw 
undue pressure." Seven said that-children> enjoyed participating ^ the 
program much or very much. Six indicated ethe objectives of ICP had been 
; " accomplished. very well and one moderately well. BRP objectives had been 
; accomplished very well according to five principals and two assessed 

■-(- accomplishments as. moderately well.. Five judged the SWRL Program as 

i superior to other -kindergarten programs vjhile one said it was about the . 

j same and one appraised it as inferior. ^ 

si- All principals said parents wele supportive and that kindergarten teachers 

/ were positive. The program waTs judged not to be in conflict with their ^ 

• / philosophy by six of the principals, one saw some conflict. Five ■ 

/ ■ ■ suggested the program be crnti'nued and four said it should be expanded. 

i • ■ No one opted for eliminating (the program. 

I ^ . ■ ^ 

I 

./•••*•■ 1 • - ., 

sm^L CHILDREN ONE YEAR LATER ' ; 

In order to more completely assess the long^.r range outcomes of the SWRL 
Program, a longitudinal study was conducted. Dr. Michael LaBay, Director 
. . of Evaluation, assisted with this portion of the study. His report is in- 
/ eluded here,. 



INTRODUCTION . . . 

ing Program reading nchitsvcment . 

A description of progra. components Su"elines and evaluation -Jj^^^/- 

file with the Dcpnrt..ent of Curriculurn. Th s report ^^/^J^^^^^^i.-.^^j.^ ^s 

tion effort involving -""f^^^-^^^^j 'a"o; m;n of acadLic progress using 
well as diagnosis, prescription, and assessment ui. 
pupil performance objectives. 
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PURPOSE OF TIE REPORT ' ' ' - ' 

This report presents accdcmic test results and analysis in an attempt to deterr 
• mine If SWRL sturten^difCer from non-SWRL students' in reading achievement at 
■ the end of their^flrst; year. 

PROCEDURES OF TIK STUDY " , ' ' • • 

A random sample of first grade pupils enrolled in the Birmingham Public Schools • 
— as--of -May-V1974- was -used in the atudy._„Pupils wer_^elccted by pro, ortional 
allocation based upon first grade enrollment within each of the disr.i ict S" - 
ae^ntary schools! An original sanplc of 50 SWRL and 5C contro children were 
Srawn frSn student lists. Groups of pupils ranged in si^e from I (Westchester) 
to 9 (Quartjn). All schools except Bloon.tield Village wre included in the 
project. 

The school recoras of each of the 100 children selected for testing- were "viewed 
to doSble cJeck building location and to record acadernic aptitude scores obtained 
on the Primary Mental Abilities (PMA) Test the previous year. 

Of the 100 original pupils selected for study. 44 SJRL and 28 control children 
had recorded PMA total scores &nd were available for achievement testing. It 
is assumed, therefore, that thfese final pupils were a random sample of all . 
cSudJen wltSrthe district w.'^o were given the PMA in. 1972-73 and were enrolled 
in their respective schools as of May 1, 1974. ^- . 

One test coordinator aLinistered the entire PACER-I (Book Two) Initial Reading 
■ ^rvey to all study pupils in sill groups (less than 4) from May 14 'trough 
MaJ 28. 1974/ Testing procedure?, as defined in the PACER manual^ were .followed 
with all the/ children. \ 

I - - 4 \ - 

RESULTS . ■ , 



Mint-Pacer analysis of test *core^. without controlling ■ ^•^^'^^'"^'^^^P';^"'*^,. 
indicated that Ihe SWRL and control pupils attained similar scores on each of 
the six PACER subtests. Tabl6 1 summarizes these "<.w.i,„.y:. 

\ \ ■ \ 



MTNI-PACER ANALYSIS RESULT^^ SWRL AND CONTROL >tEAN PUPIL ACHIEVE^tENT' I£VELS (FAtRR-lL 



Subtest No* 
Pupil Count 
Mean 

Std* Dcvel* 



SWRL Subtest Performance 
1 2 3 4 



Smh Subtest Performance 
1.2 3 4 



44 

11.98 
0.15 



44* . 

8.00 

0.000 



44 

7.61 

1.05 



44 

6.98 

1.51 



44 

7.57 

1.05 



44 

10.07 
2.77 



28 

,11.93 
\0.37 



28 

7.86 
0.44- 



28 

7.75 
0.83 



28 ■ 
.7.18 
1.49 



28 28 
7.46 10.54 
1.40 1.82 



Subtest Definitions: 



1= Sight Vocabulary 

?= Initial Consonant Substitution 

3= Compound Words 



\3: 



Inflected Endings , ^ * 

Comprehensiort, Sentence Completion 
Comprehension, Main Idea, Sequence 
. and Detail* 



considering the proportion of pupils correctly answering all items within subtests. 
Table II indicates that significantly more SWRL childret^ attained perfect scores in 
subtest 2 than control. All other subtest breakdowns iridicatc no significant dxfference 
between the two groups. t \ 
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TABLE II 



MINI-PACER ANALYSIS RESULTS OF SWRL AND CONTROL CRITERION ATTAINMENT 
(CRITERTON SET AT MAXIMUM SCORE) 



I 



SWRL Subtest Porfonnance 



SWRL Subtest Performance 



Subtest No* 


1 


2 


3 


4 ' 


5 


6 


' 1 


2 


3 


4 


5 6 . 


Pupil Count 




44 


44 


44 


44 


.44 


28 


28 


28 


28 


28 28 


Aclileved 
Criterion 


/43 


44 


38 


27 


36 


23 


27 




25 


20 


23, 12 ; • , 



Number Si^bt^st 
1 
2 
3 
4 
5 
6 



Sigh^ Vocabulary 
Initial Consonant Substitution 
Compound Words'. ■ " 

InMcctcd Endings ^ 
Comprehension, sentence comp# 
Comprehension, llai^^ Idea', etc* 



Comparison between groups using z-test of proportions 
No significant difference 



Significant uifference 
No significant difference 
No significant\diffcrcace 
No 'significant d^if fcrcnce 
No significant difference » 



1- 



When each subtest score was\controIled for academic aptitude- through covariance analysis 
(PMA total raw. scores used afe covaijiate) results indicated/ that: , 

1. The SWRL and the control, groups were not significantly different in their 
PMA scores. / 

2. The correlation between PMA scores arid pACER subtest scores was nonsigrtificant. 

3. The' two groups did not differ in achievement on any PACER subtest when, 
academic aptitude controls were enforced. , 



Tables 3 through 8 summarize the above findings 



(7) 



1 COI ,i.USIONS 



The information presented in this report indicates that children with one yer 
of previous experience in the SWRL Program\at the K level did not achieve at 
level significantly higher than children in ether progr^uns throughout the 
-distr ic t— as -measured-by-the-PAGER-batter^.- 



ar 
a 



The two sample groups selected for study were\iot signific^tly different in 
academic aptitude; as measured by the PMA battery. .\. 

When each child's aptitude was consid^ed througH covariance analysis procedures, 
the SI^RL group again was not significantly different in PACER-mea?ured reading 
ability. ' - 

Assuming that PACER ba.tery adequately measures the ability to 'read ^he en^ ^ 
of grade one, the data of this report indicate:, that the district's SWRL Program 
did not produce achievement levels above those expected in other district program. 

Dr. Michael LaBay 
Director of Evaluation 
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SUMMARY OF FINDINGS AND CONCLUSIONS 

As one reads through this report, there are many minor and a few major con- 
clusions. The more pertinent" ones .will be listed herei Additional questions 
asked about the program as it was developed by the Southwest Laboratory are 
/ included in Appendix ^H. 

In the opinion of the parents, teachers, and airr"'' ^tors, who. 
participated in the project, the objectives o^ ^ Instructional 

Concepts Program and the Beginning Reading Pro^^^v a were accomplished, 
This opinion is substantiated by end -of -program test results. 



2. 



Children who^par^ticipated in the program scored signif icai^tly better 
on subtests (a) measuring knowledge of sight words, (b) word elements, 
(c) sentence meaning than did control children who did not participate. 
There was no significant difference in ach^.evement of the experimental 
and control group on subtest (d) naming letters. This latter finding 
suggests that non-SWRL teachers are teaching letter recognition. This 
is an outcome of the phonovisual prqgr^am which is taught in many schools. 

* There was no significant difference in the reading achievement of SH^L 
and non-SWRL children as determined by the \PACER Reading Test administered 
at the end of grade oW. This 'finding is. difficult to explain in view 
of the. substantial dijfcterence in achievement. foun,d at the end of the 
kindergarten -year. The possibility, suggests itself that first grade 
teachers are not maintaining the reading achievement lead that SWRL 
pupils evidenced at the end .of their kindergarten year. Another 
possibility,, ^of course, is that the. program really does not, in the 
Icniget term, make a lasting difference. 



.4. Parents, .teachers, and administrators expressed strong support for the 
program and wished to see it continued. . ■ 



RECOMMENDATIONS 

1.. The SWRL Kindergarten Program should be continued as an optional 
program in the district at the kindiergarten level. 

2. All but very immature kindergarten children in a school where the 
program is offered should be included in an instructional group and in 
the program. ' \ 

3. Use of- support systems li^V^commended. , Unhealthy pressure must be 
carefully avoided. 



•10. 
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Schools that have the program and plan to continue it are advised to 
assess their reading program delivery syst^.i- at the first grade level 
to determine if there may be ways of maintaining the achievement lead 
evidenced by SWRL children- at the end of their kindergarten year. 



Dr. Frank Goetz, 
Director of Curriculum 



/ / 
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ICP PROGRAM OUTCOMES CHART 



APPENDIX 



UNIT 1 - COLORS AND DIRECTION 
FOLLOWING SKILLS 

INITIAL INSTRUCTION 



1* Red. Blue 

2 Yellow. Black 

3 White, Brown 

4 Green, Piiiple - . 

5 Orange. Pink 

6 Row, Numerals 1 to 5 

7 Turn. Page. Mark, Box 
ASSESSMENT 

8 Criterion Excrchc - Unit 1 
SECOND INSTRUCTION 

9 Practice Exercise A - Unit 1 
10 Practice Exercise B - Unit 1 



UNIT 2 -SIZES 

INITIAL INSTRUCTION 

1 Larger, Smaller. Largest. Smallest 

2 Shorter, Longer, Longest 

3 Shorter, Taller. Shortest , Tallest 

4 Thicker, Thinner 
, ASSESSMENT 

5 Criterion Exercise - Unit 2 
SECOND INSTRUCTION 

6 Practice Exercise A - Unit'2 

7 Practice Exercise B - Unit 2 



UNIT 3 -AMOUNTS 

INITIAL INSTRUCTION 

1 One, Two, Three, I'our 

2 Five, Six, Seven 

3 Eight, Nine, Teu 

4 AU, Some, None, No 

5 More, Less, Most, Least 
ASSESSMENT 

6 Criterion Exercise - Unit 3 
SECOND INSTRUCTION 

7 Practice Exercise A - Unit 3 

8 Practice Exercise U - Unit 3 



UNIT 4 -SHAPES 

INITIAL INSTRUCTION 

1 Circle, Square. Triangle 

2 Rectangle. Straight and Curved Lines 
ASSESSMENT 

3 Criterion Exercise - Unit 4 
SECOND INSTRUCTION 

4 Practice Exercise A - Unit 4 
5 . Practice Exercise B - Unit 4 



*lesson number 



UNIT 5 -POSITIONS 

INITIAL INSTRUCTION 

1 Front. Back. Middle 

2 Top* Bottom, Side 

3 Behind. In Front. Between 

4 ' Beside, Next ToMround 

5 Above. Below* Over, Under 

6 iJnside. Outside 

7 iRight.Lcft 

8 First. Last. Beginning. End 

9 First. Second. Third. Fourth 
ASSESSMENT 

Criterion Fxcrclsc - Unit 5 
SECOND INSTRUCTION 

pTJCliiv Ivxcr^jiNC A - Unit 5 
. Practice Kscrcisc B - Unit 5 



10 

w 



UNIT 6 - PRE-MATHEMATtCS 



INIIIAIINSimilON 

1 Vi\\u\l Uiioqiul (A|»^^"[»^^> 

3 



Same. DillVuni (Si/c, Slwpc. Color, Amouni) 
Not FqtuI or Not Suiiic 



Combined. Colors and Shapes 

Coi. Jincd Colors and Sizes; Shapes and Sues 
' Combined Shapes and Positions. Sizes and Positions 
ASSESSMENT / 

Criterion Exercise f Unit 6 
SECOND INSTRUCTION 

Practice Exercise A - Unit 6 

Practice'Excrcisc B - Unit 6 



/ 
/ 

UNIT7-PRfFVEADING 

(If the children hzL already begun 
to read, the Icssoi^ in this unit may 
not be n.^cc$sary.) 

INITIAL INSTjiuCTION 

1 First. Last rriiiic) 

2 Before. After (Tinie) 

3 l.ctlel. Word 

4 Smiiul. Name 
ASSISSMFNT 

5 CsiU'iionl'Ncriisc ^ Uiiil 7 
SliCONDINSIKlK riON , 

6 l*r.u luv iMit ivi- A Uinl 7 

7 Pi.ii luvF\t uiseH Unit 7 
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BRP PROGRAM OUTCOMES CHART APPENDIX B 
Outcome 1: Words that the children learn to read 

Outcome 2: Beginning and ending word elements that the children learn to identify 
Outcome 3: Word-attack skills that the children learn to apply 
Qutcome 4: Letter names, both for capital anc lower-case letters, that the 
children loam to identify when shown the letters 



Unit 


No. of Weeks 


Outcome Number 

1 2 3 4 
Words Word Elements Word Attack Xetter Names 


25 min. 
porday 


40 min. 
per day 


1 


5 


3 


1 Sam see am 
me Mat 


s m at 




s m e 
a 1 t 


2 


3 


2 


Mit Sis meet in 
it sit on is 


^it e« 


n o h 


3 


3 


2 


sat ' Ann this and 
Nan a man the 


th an a 


w f d 


4 


3 


2 


mad that at Sid 
we will with fell 
mess 


ad w ill f 


1 r b 



Unit 


25 min. 
per day 


40 min 
per day 


Outcome 1 .2 3 4 

Words Word Elements Word Attack Letter Names 


5 


3 


2 , 


fit Nat sun them, 
us what feet fun 
nm 


un r 


By Unit 5 and 
thereafter, 
ihe children 
should be 
able to sound 
out and read 
any one* 
syllable word 
composed iir 
' word elements 
taught pre* 
viously in 
the program. 
Specific words 
for word- 
attack iiK 
struction are 
listed in the 
Activittes.and 
Materials Guides. 


u c y 


6 


3 


2. 


Nell who .yes ^did 
Ed let well need 

she • . ^ 


ell et 1 eed 




7 


3 


2 


net ran sad no 
fjtl sheet shut mud 


ut sh 


P k g 


8 


\ 3 


2 ^ 


sand sell shell fish 
hat he then nut 
rat set feel . not 
fat if wet 


en h 
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3 


2 


fan ^ win hand hill 
seed weed met hit 
was to bad . him 
men . be 




X z j 

q V. 


to 


3 


2 


bat his wish ball 
b^ll but has said 
ant Ben '*bus had. 
bed ^ bee Biir hid 
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- ^ . . . APPENDIX d; . 

SWRL KINDERGARTEN PROGRAM 
' ' PARENT* OPINIONNAIRE 

Schoo l 8 Schools — 149 returns 

I 

To help evaluate the SWRL Kindergarten Program used on a limited basis in Birmingham 
this last year 9 we are requesting that teachers, parents and administrators react to 
several questions. Your assistance is appreciated. Check all appropriate items» 
Please return the form to school within two days, 

1. My child has enjoyed participation in the SWRL Program 

75,2% 17,47, 6,0% .7% , 

112 v ery much 26 m uch 9' s ome i v ery little ^ n ot at all 

2. Did you receive printed literature expl,aining the SWRL Program? . « ; , 
96,6% 3,4%. • i 

144 yes Sno^ Comment on its adequac y adequate, excellent, informativ e 

ea3v> too difficult, Qood, not as expected 



3. Did -you participate in a parent orientation program at school? 
61,7% 38,3% . . 

92 y es' 57 n o^ , 



4.T To the extent that I am able to judge, the objectives related to teaching con- 
cepts of color, size, etc, were accon^llshed, 

90,3% 8^7% " . • 

131 v ery well 1^ m oderately well . poorly 

5.. To the extent that I am able to judge, the objectlvtes related to teaching 

beginning reading were/are being accoiq)llshed - 
78*3% 20,3% ^ - 1.4% ,r - : 

108 v ery well 28 m dderately well ^ p oorly 

6* The SWRL Program has had fche following effect , on my child 

81,9% \ 2,7% 10.7% 

1 22 s timulated and challenged j gnduly pressured-^ -^^Jf^both 

7^ n eitheiLJ^^- r— ^ — , 

- — — =-4^7% _ _ • ; ^ . . • 

J. Compared to other^Kindlergarten Programs _1 mfanlliar with, the SWRL Program is 
85,6% 10,6% ! ^•^'^ T^^- 

t;i3 s uperior 14 a bout the same ^_^_,inferior - - _ 

8, Having participated in the Parent Assistance Program (PAL) my reaction to Its 
effectiveness is 

51,5% • 29,8% 15,7% 3;q% 

^ very favorable 40 favorable 21 m ixed emotions ' _J_unf avorable 

9, The part(s) of the SWRL Program my child liked most was:* 

Reading and Books, Games. Numbers, Tests, worksheets. Merit badge. All, Puzzles, 

Stories and characters, pictures, humor ' , 



50 23 
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SWRL KINDERGARTEN PROGRAM 
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TEACHER . OPINIONNAIRE 




*' 


MARCH 1973 


Rrhnol • TALLY ■ . . ■ 



To help evaluate the SWRL Kindergarten Program used on a limited basis in Birmmfihajn 
this last year, we are requesting, that teachers, parents. and administrators react to 
several questions. Your assistanpe is appreciated. Check all appropriate areas ana 
return- to the Director of Curriculum within 2 days. 



1. 



2. 



3. 



4. 



6. 



ERIC 



My participation- in the SWRL Program was: 

6 satisfying 



A. — ICP 

2 v ery satisfying 



so so 



Unsatisfyins 



B,- — -BR? 

^ 4 v ery satisfying' 



3 s ati 



isfyj.hg 



so so 



uhsatisfying 



not at all 



The children enjoyed participating in the SWRL Program 

A. —Instructional concepts: 5 v ery much 4 ^^"^^ — 

B. —Reading: 7 v ery much \j some not at all , ; 

The time required to adequately teach the Instructional Concepts Prosrum was: 

- . . 4 just ,r ight ^ excessive 



The time required to adequately teach the Reading Program was: 
5. just right 2 excessive 



5, In wha.t„ways-was-^-he-Program-g-Ood~fbr your- children? 



A. 
B. 



•What approximate percent of parents/reacted to the program? 

48^nthu?i-ast±ca-lly-29T^ li5__ncg?tivoIy 



7. In terms of readiness for the ne4 school year, SWRL children compared with 
non-SWRL children' (this year or^ other years) 

- 4 b etter prepared A a bout the sama ^less well prepared 

8. Objectives of the Instructi'«jaL Concepts Program were accomplished 



7 very well^ / 1 m oderately well 



^poorly 



Objectives of the Begip.ning Reading Program were accomplished 

# : ■ ■ . ■ - ■ 

" ' poorly 



6 very well 



3- m oderately well 



10. 



11. 



7 time^ consuming but necessary 



Record keeping was: 
' — problem 

X ; unnecessarily time consimlng 
The SWRL Program in terms of my 1973 Kindergarten Philosophy is 

7 a cceptable ^2 . jn conflict (explain) 



12. The PAL Program was 

7 h elpful 1 u nnecessary 



not used 



^a problem (explain) 



13. ' The Tutor Program was 

4 h elpful u nnecessary 3 n ot used 



^a problem (explain) 



14. District In-Service preparation for participation in the program was 
^ 1 v ery adequate 5 adequate 1 inadequate 



15t- 
16. 



177 



-WouTd you want to participate in the SWRL Program next year? 



Yes 



no 



\ 



eliminated 



18. 



19. 



I feel the program should be: 

^ 6 c ontinued ^ _ _ -6 -e xpanded ^ 
Criticisms of the program: \ , 

A. lecord Keeping is a problem , 

B. Holding to a time schedule . . - 
Suggestions for improving the teaching of the program. 

Introduce vowels screen out children not "ready" Re-evaluate time Siphedules 

" ' Grouping children may help ' 

Additional Comments: / ' 

ICP is not necessary for some children 




ERJC 



SWRL . KINDERGARTEN PRqCBAM 
ADMINISTRATOR OPINIONNAIRE 

March, 1*973 School > 



To help evaluate the SWRL Kindergarten Program used on a limited basis an Birmingham 
this last year, we are requesting that teachers, parents and administrators, react to 
several questions. Your assistance is appreciated. Check all appropriate areas. 
Please *etuEn to the office of Director of Curriculum-within 2 days. 

1. The SWRL. Program has had the following effect on the children in my building. 

>; ' 5 s timulatfid^ and challenged _1 ^unduly pressured, 

1 n o noticeable dif fereuce from previous program - 

2I Children have seemed to enjoy participating in the Program. 

_X_veryWch \A__much 1 s ome very little " ___not at all 

3. In my estimation the -objectives of the Instructional Concepts have l^en • 

6 very well 1 m oderately veil poorly ^ " ' 

4. In ray" opinion the objectives of the BRP are 'or have been accomplished. 

5 v ery well 2 i oderately well poorly 

I 5. Compared to other Kindergarten Programs the SWRL Program is . 

5,.:; s uperior^ ~T a bout^saoe -1^ — ini^tiov- r-^- — 



6. We oriented parents to the program by 

\, 7 p roviding literat^ " J._coiiducting an orientation program at school 



^other* 

. (comment on parent reception of this orientation^ 



7. With regard to the SWRL Program, parents, have^ been • P : 

7 ' supportive ^indifferent negative 

8. ' My involvement in record keeping was ■ V ^ 

6 n o problem 1 time consuming but necessary ^excessively time consuming 

9. "3h^ reaction o* the kindergarten teacher involved in the program has been V . 



7 p ositive Indifferent ^negative. 



10. 



11. 



12. 



The SWRL Program assessed in terms of my Kindergarten Philosophy is 
6 a cceptable 1 l u conflict (explain) . 



13, 



I feel the program should be 

5 c ontinued 4 e xpanded 

The^fiTProgram was 
6 h elpful u nnecessary 



eliminated 



1 not used 



__a problem (explain) 





The Tutor Program was 






3 helpful unnecessary 


4 not used 


a problem (explain) 














./ 













14. At my school, if given the opportunity next year, I would like to involve 

7 a ll kindergarten classes 1 class n o class 

X5« CriticiGm of Progranji — — 

16. Suggestions for improving the operation of the progra m Re-evaluate pacing schedu le; 
Include all children in program but fit it to their needs; Screen children out 



not "ready^* 



17 • Additional comments: 




SUBTEST RESULTS OF PACER READING TEST 



Table 3 

SWRL Evaluation for Goetz By LaBay (1974) 

Data Format (Il,'F3.0,6F2.0) - SIGHT VOCABUURY 



ANALYSISj OF COVARIAKCE: Problem No. 1 Covariate Variable 1 Criterion Variable 



1 

Sources 




DF 


ssx 


SP 


: SSY 

V 


ADJ DF 


ADJ SSY 


ADJ MSY 


Between 




1. 


'268.000 X 


1^.875 


1.332 


1. 


1.563 


1.563- 


Within 




70. 


6783.000 


-49.938 


132.613 


' 69. 


132.246 


1.917 


Jotal 




71. 


7051.000 


-31.063 


133.945 


70. • 


133.808 




Analysis 


of 


Variance 


(Covariate) 


F = 2.766 


DF = 1, 70 • 


Omeca Squared 


=-0.935 




Analysis 


of 


Variance 


(Criterion) 


F = 0.703 


DF = 1, 70 


0nef»a Squared 


= 0.962 






of 


Covariance(Crict:rion) 


F = O.ol5 


DF = 1, 69 


OmeRa Squared 


= 0.960 




Correlation 


of Gov. 


Crit. Vnr. 


= -0.032 


Slope = -0.007 







Table 4 

SWRL Evaluation for Goetz By LaBay (1974) 



DataForr^t (II, F3.0, 6F2.0) - I NITIAL CONSOMANT SUBSTITUTION „ ^ . 

Data Forr^c ^ j _ Covariate Variable 1 Criterion Variable 3 



ANALYSIS OF COVARIAMCE. Problem No. 2 



Sources 

Between 
Within 



Total 



DF 



SSX 



SP 



1. 


268.000 


4.875 


70. 


6783.000 


-22.625 


71. 


7051.000 


-17.750 



SSY 

0.090' 
59.410 
59.500 



ADJ DF 



ADJ SSY 



1. 


0.121 


69. 


59.335 


70. 


59.455 



ADJ MSY 

0.121 
0.860 




28 



■ Table 5 ■ ■ 
SWRL Evaluation for Goetz By LaBay (1974) 



Data Fortnat (II, F3.0, 6F2.01) - i mECTED ENDINGS , 

■ ai.AT.VSIS of COVARUKCE. Prob No. 3 Covarlate Variable" 1 Crlterxon Variable^ 



ADJ SSY ADJ MSY 




Between 
Within 
Total 



1. 


268.000 


-6.375 


70. 


6783.000 


75.563 


71. 


7051.000 


69.188 



0.152 
179.629 
179.781 



1. 
69. 
70. 



178.787 
179.102 





Table 7 

SWRL Evaluation for Goetz By LaBay (1974) 



Data Formt (II, F3.0, 6F2.0) - COMPREHENSION-- SENTENCE COMPLETION 



Sources 



DF 



ssx 


SP 


SSY 


AD J DF. 


ADJ SSY 


AD^ MSY 


268.000 


-10.563 


0.414 




0.669 


oi669 

/ 


6783.000 


78.813" 


226:906 


69. 


225.991 


3.1 275 


7051.000 


68.250 


227.320 


70. 


226.660 





Between 

Within 

Total 



1. 
70. 
7X. 



Analysis of Variance (Covaria.te) F " 2.766 DF = 1, 70 Omega Souared = 0.935 



Analysis of Variance (Crifrion) F = 0.123 DF = 1, 70 On-ega Souared = 0.9/0 
Analysis of Covariancc (Criterion) F = 0.204 DF = 1. 69 Onega S ouared = O.Vuj 
Correlation cf Cov. a Crit. Var. = 0.Q5A Slope = 0.012 - \ 



Table 8 / 
' SWRL Evaluation for Goetz by LaBay (1974) 



Data Format (II, F3.0, 6F2.0) COMPREHENSION - MAIN IDEA, ETC. 




A;7;rn;^TT-^v Triance Ic^^a riate) F « 2. 766 DF ^ 1. 70 Omer.a Souared = 0.93d 

An^IvM^ of Covari l^^ Critericn) F = 0.V10 DF =1 69 Ce,. Souared j 0.9o9 
Correlation of Cov. & Crit. Var. =0.067 Slop^ = 0,P34_ 
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APPENDIX • H 



t QUESTIONS ASKED ABOUT THE . 

SWRL KINDERGARTEN PROGRAM 

^ I 

W-5S the SWRl.^Kihdergarten Program developed for use with groups or with 
individual children? 

The instructional program was developed to be effective when 
instruction is provided on a whole class, small group, or individual 
basis. The program has been shown to produce the intended outcomes 
with high dependability in a variety of instructional settings. 

Is the Instructional Concepts Program (ICP) a reading readiness program? 

ICP was developed to help kindergarten chi^ldren quickly learn 
conceptual skills identified as fundamental tp^ academic achievement. 
It is a general school readiness rather than a reading readiness 
program* ICP is not a prerequisite for the Beginning Reading 
Program (BRP), which is a .complete beginning reading program for 
the kindergarten pupil. The development of prerreading and direction- 
foilpwing skills is stressed in early sections^ of BRP* 

How were the concepts selected for ICP? . ~ 

From an analysis of curriculum guides, a list of concepts commonly 
used in first-grade instruction was compiled. This list of concepts 
was revised in accordance with the suggestions of experienced pri- 
mary grade teachers and curriculum specialists, and analyses of prer^ 
test and posttest performance of more than l.,400 kindergarten children. 

Are the two programs, BRP and ICPj used concurrently? 

ICP is not a prerequisite for BRP. However, it is suggested that 
if both ICP and BRP are to be used, that one or two units of ICP 
. be completed before instruction in BRP begins. The initial experi- 
ence of teachers and pupils with TCP will facilitate the introduction 
of BRP. After Unit 1 of ICP is completed, BRP Teacher Training should 
commence so that BRP can be introduced concurrently with ICP Unit 3 
or sooner.; Since ICP takes approximately 12 weeks to complete, the 
two programs will run concurrently for approximately eight weeks. 

How has program effectiveness* been insured? - 

Effective product development procedures typically involve field testing - 
of the product undei^ conditions similar to those in which it will ulti- 
mately be used and revision of the product based upon performance of 
pupils under those conditions. The SWRL Kindergarten Program has been 
tried out with more than 100,000 kindergarten children. Each of the 
Kindergarten Program components has undergone continuous sequential 
evaluation. Beginning with early formulation activities in 1966, through 
the large-scale tryouts of 1969-70 and 1970-71, the Laboratory h^s 
continued to modify the Kindergarten Program on the basis of pupil 
performance data and teacher feedback* The Kindergarten Program if 
now ready^or large-scale distribution* 
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6. How was the et fectiveness of the Kindergarten Program evaluated? 

The Kindergarten. Program underwent the continuous formative evaluation 
cytle of development, evaluation and revision. Data were collected,, 
through criterion-referenced testj; based on prespecified program out- 
comes, classroom observations by development personnel, and question- 
naires and meetings with tryout teachers.- r 

^ The measurement of pupil performance was criterion referenced. .This 
means that measures were employed to determine a pupil's achievement 
in relation to an established performance criterion. The criterion- 
referenced approach to evaluation may be contrasted with norm-referenced 
measures, employed to determine a pupil's status in relation to others 
on the same instrumen.t . The overall effectiveness of BRP was thus 
continuously evaluated in terms of the degree to which its designated 
instructional outcomes were attained in a variety of settings and at 
a given cost level. 

7. What data exist on the effects of structured reading instruction on the 
personality'ot, the kindergarten child? 

Extensive data regarding the effects of BRP on kindergarten children ' 
were collected during the five-year tryout period through classroom 
observations and questionnaires completed by teachers and parents. 
Teachers and parents reported that their children did not experience 
undue pressure In the. reading program, and that the children enjoyed 
' participating in the program more than they enjoyed most school 
activities. 

.8. Was' the Kindergarten Prosram developed for use with children of a particular 
aptitude level or socioeconomic status? • ^ 

The Kindergarten Program was developed to accommodate the entire popula- 
tion of children who had not yet achieved the program objectives. A 
wide aptitude range was considered in the development of the program, 
and the widest possible range of socioeconomic status was included in 
field -testing. The progrim was .individualized such that students of all 
abilities could function at levels appropriate to their needs. 

9. How is the progress of individual pupils assessed? 

The programs are organized into units to provide check points for 
assessment of each child's progress. The teacher is able to verify 
the skill attainment of each child by administering the Criterion 
Exercise following each unit of instruction. If necessary, the 
teacher can. prescribe certain Practice* Exercises for pupils Wno have 
not yet attained the unit skills. 

10. Are the Criterion Exercises a form of standardized test? 

. No. Criterion Exercises assess pupil learning on specific outcomes. 
They are not general achievement measures and are not used to compare 
pupils. ^ - . * , . 




II* what are duration and number of units o£ each instructional^program? 

The ICP consists of seven units and is completed in approximately 58 - 
days if 20 minutes per day are used for- instruction. The BRP is 
. organi2jed into ten units. Tryouts indicate that children are able 
to attain the, planned learning outcomes of BRP when-^an average of 
approximately 25 minutes per day are used. 

12. Does the Kindergarten Program affect a teacher's normal grouping procedures? 

' ^ ■ ^ . #' 

The classroom can be organized in any way suitable to the teacher. 
. The program permits individualization of instruction based on reliable 
information concerning the progress of each child. 

13. Does the Kindergarten Program include learning games? 

Games suggested for use with each' unit of instruction are designed to 
maximize the participation of children in activities which; relate 
directly to attainment of unit skill'i. 

14. ^Can any of the activities in the. Kindergarten Program be performed by a 

non-professional? . 

When learning tasks require considerable practice (as they do in learning 
to read), non-professionals can help maintain and strengthen learning. 
The assistance of aides, -^parents, and other students can be a powerful 
tool in maximizing learning outcomes and individualizing instruction • 

15. Must the suggested instructional schedule be followed?- . 

/ ^ It is recommended that the suggested instructional scheduling be followed 
in order lo complete the program during the school year and to maximize 
skill attainment. Time allocations should be adjusted by the teacher to 
' adapt to the abilities of the children in a given clas/s. 

16. Were the Instructional Support Systems developed for use with all pupils or 
just for those requiring additional help? 

c _ _ 1 

The Tutorial Program supplements regular classroom instruction in BRP by 
providing individualized practice for those pupils requiring additional 
help to attain program outcomes. The Parent Assisted Learning Program 
supplements regular classroom BRP instruction for the entire class by 
utilizing the structured assistance of each child's parents. The Summer 
Reading Program is a parent-managed program used following the kinder- 
garten year. The program was developed to maintain the reading skills 
acquired in kindergarten. 

17. What data exist on the effectiveness of the support programs (PAL^ Tutorial 
and' Summer Reading), in supplementing the reading instruction presented by 

^the teacher? 

Tryouts of each program revealed that its use in combination with BRP 
resulted in^ncreased pupil achievement' over use of BRP alone. 
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18. How structured is each of the Support Programs? Are there specific procedures 
for the tutor or parent to follow in responding to the pupil's answers? 

The speci^ly prepare'^v materials used by tutors land parents provide 
pupils with individualized practice on program' outcomes. Tutors and 
parents are trained in sp^e^ific support skills such as how to respond 
to. incorrect answers and how to conduct instructional practice sessions. 

19. Arc the Practice Exercises in the Tuto^-ial Program different from the Practice 
E.^ercisos in BRP? 

No, the same Practice Exercises are used in both programs. These exercises, 
assigned on the basis of each child's Criterion Exercise performance, are 
designed to provide additional individual practice on specific unit skills. 

20. Does the Summer Reading Program material include the same^ storybooks jand___ _ 
practice exercises used in the BRP? ^ 

Parents using the Summer Reading Program receive ten weekly kits o£ 

specially prepared materials. 'Each kit contains practice exercises, 

n storybook, a record sheet, and an animal postet. ^ 

•21. What is included in the Kindergarten Program Quality Assurance System?^ 

The Quality Assurance_.Sy_stem includes assessment materials and procedures 
developed to provide en route information on each aspect of the instruc- 
. .tional and instructional support programs to insyre that the prespecified 
• performance critetia have been attained. 

22. What kind of training>^<provided for the Kind.ergarten Program? 

School district personnel are trained in progra,:. use prior to their 
participation in the Kindergarten Program. The Laboratory has developed 
systematic training- programs for each of the instructional and support 
system^. Each training system includes: 1) a program for training 
district appointed trainers who in -.urn assume responsibility for train- 
ing teachers, and 2) a program for training teachers. 
The training system is^organized to require approximately Ik hours -per 
program. . ' 

23. Can initial orders be placed for individual components of ICP and/or BRP, 
e.g., tor storybooks only? 

The integrity of instruction is protected by rest,ricing initial orders 
to complete instructional systems: ICP and/or BRP. 

2A. Are the support systems available for purchase independent of the BRP? 

Availability of the support systems is contingent upon purchase^ of the - 
BRP. The support systems. were developed and structured to supplement 
BRP, and assume initial BRP instruction by the classroom teacher. 

25. How were publishers notified of the in*:ended private sector distribution of ! „ 
the Kindergarten Program? 

All eligible publishers received the February 15, 1971, Request for 
Proposal and all had an equal opportunity to respond to the BRP for 
publication and marketing of the program. 
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